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Abstract 

Quitting games are one of the simplest stochastic games in which at any stage each 
player has only two possible actions, continue and quit. The game ends as soon as at least 
one player chooses to quit. The players then receive a payoff, which depends on the set of 
players that did choose to quit. If the game never ends, the payoff to each player is zero. 

Examples of quitting games were studied first by Flesh, Thuijsman and Vrieze in 
1997 ([I]). Solan 1999 ([5]) proved that all three- player quitting games have approximate 
equilibria. In the paper Quitting Games Solan and Vieille 2001 ([7]) proved the existence 
of subgamc-pcrfcct approximate equilibria under some restrictions on the payoff function. 
Furthermore Solan and Vieille studied in a four-player quitting game example in which 
the simplest equilibrium strategy is periodic with period two. In The structure of non- 
zero-sum stochastic games ([5]) Simon showed under which properties quitting games 
have approximate equilibria among other things by generalization of the solution-idea 
from Solan an Vieille. 

This paper gives a short introduction into the topic quitting games and tries to illus- 
trate several properties with examples. First the mathematical model of a quitting game 
is presented. After the definition of the strategy and strategy profile the corresponding 
probability space and the underlying stochastic process are stated. This leads to the 
expected payoff and the definition of some equilibria. 

For a better analysis of quitting games the so called one-step game is introduced in 
the second part of this paper. Important properties of strategy profiles in one-step games 
are posted and proved. 

In the third section an important theorem from Solan and Vieille (cf. [7]) is cited, 
in which the existence of approximate equilibria, under some assumptions to the payoff 
function, is postulated. It's proof is divided into three parts, however this paper concen- 
trates only on the first one. In the referred literature only a few steps of the proof are 
denoted. It is the aim to show the proof at length under usage of the then known results. 



1 The model 

A quitting game is a sequential A^-player (JV € IN) game and played as follows. In every game 
turn each player has only two possible actions continue and quit. The game ends as soon as at 
least one of the iV-players chooses to quit. We denote S (quitting coalition) as the subset of 

'This article appeared under the former family name Heimann in the conference proceedings of the "Inter- 
national Symposium on Dynamic Games and Applications", Wrolaw 2008. 
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the players who choose to quit. If S = the players receive no payoff and the game continues 
to the next stage. If S ^ each player n G {1, . . . ,N} receives the payoff G R and the 
game terminates. 

Definition 1.1 (Quitting Game) A quitting game is a tuple 

G = (Af,(rshcscM) (1) 

where 

- J\[ = {1, . . . , N} C M is a finite set of players, iV6l, 

- S G V(Af) denotes the quitting coalition and 

- (rs)seV(Af) € ~$& N is a sequence of payoff-vectors to the players under the quitting coali- 
tion S with r = (0 := (0, . . . ,0) T G H N ) and r s = (r s , . . . ,rf ) T . 

Remark 1.2 A quitting game is a special case of a (stochastic) game, where transition prob- 
abilities are even deterministic. For comparison (cf. e.g. ^j): 

- The state space is given by Z := {S | C S C J\f} = V(M). 

- The action space is given by A := {0, 1}^, where stands for continue and 1 for quit. 
We denote as = {a s , . . . , a$ ) T as element of A with 



for n G M \ S 



Vn G J\f, C S C N. 



I 1 for n£S 

The transition law t : Z x A x Z — s> [0, 1] is given by 



(2) 



t{z\$,a s ) := 
t(z\S,a s ) :-- 



1 for z = S 

otherwise 

I 1 for z = S 

otherwise 



(3) 



where z, S, S G Z , 5 7^ and 05 G A 

- 27ie payoff function is given by r : ^4 — > 11, 1— > f(as) '■= rs- 

- There is no discounting in this model. 

Example 1: A typical way to describe two- or three-player quitting games is in a matrix. 
For example let two players be given. Player one is the so called row player and player two 
the column player. 





Pla 
continue 


^er 2 

quit 


„. , continue 
Flayer 1 

quit 




(1,-1) 


(1,1) 
(-2,-2) 
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Where O means, that the players does not receive any payoff and the game continues to the 
next round. 

In this case the quitting game is given by 

0\ f 1\ f 1\ ( -2 

-2 



G= {1,2}, r = Q ,r {1} =[ _ x ,r {2} = f 1 ,r M 



For further analysis the term "strategy profile" is needed. 

Definition 1.3 (strategy profile, strategy) Let G = (J\f, (rs)<ncscAf) be a given quitting 
game. A sequence of probability vectors tt := (pj)ielN withpi = (pj, . . . ,pf) T G [0, 1]^ is called 
strategy profile in the quitting game G for the players 1, . . . , N . p™ stands for the probability 
that player n will play the action quit at stage i. The sequence ir n := (pf)^^ is called strategy 
for player n, n € M . 

Let IT be the set of all strategy profiles for the given quitting game. 

Definition 1.4 (subgame profile) Let G = (M, (jsOocscjv) ^ e a given quitting game and 
it = (pi)i£iN & strategy profile in G. For each j 6 IN, irj := (pi)j<i£N denotes the subgame 
profile induced by tt in the quitting game starting at time j. 

Definition 1.5 (pure, cyclic, stationary) Let ir = (pi)ig]N be a strategy profile in a quit- 
ting game G. A strategy ix n = (p™)ielN for player n is called 

- pure, if pf € {0, 1} for all i € IN. 

- cyclic, if a ko € IN exists such that p^ = p^ +ko for every k G IN. 

- stationary, if p2 = Pi for all k € IN. 

A strategy profile tt is called pure, if all strategies ir n , n € J\f, are pure. It is cyclic, if all 
strategies are cyclic, and stationary, if all strategies are stationary. 

Notation 1.6 Let tt = (pi)i^ be a strategy profile and ir n = (p™)j g ]N an alternative strategy 
for player n, n € M . We denote by ir~ n the strategy profile for the players j £ Af\ {n} and by 
(-7r _n ,7f n ) an alternative strategy profile for player n in which the players j £ Af\ {n} carry 
on playing i\~ n , that means 

p\ ...\ 

pT 1 ••• 
pI ■■■ ■ 



( p\ 



TT 



pT x vV 
pT x pT 1 



N 



P-2 



and (ir- n ,n n ) 



Pi 
Pl +l 



N 
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1.1 The underlying stochastic process 

Let G = (j\f, (rs)($cscAf) be the given quitting game, Z = {S | C S C J\f} the corresponding 
state space and A = {0, 1}^ the corresponding action space (cf. remark fl.2p . Set 

n-.= (z x A)°° 

and 

A := V{Z) ® V(A) ® V{Z) ® ® . . . . 

Furthermore and without loss of generality let z = be the initial state. If a strategy profile 
7r = (pj)ieiN € II is given, a unique probability measure P,r on (0, A) and a stochastic process 
(X k , Yk)k£iN with values in (Z x A) exist, where 

- Xk(u) = X k ((zi,ai,z 2 ,a 2 ,. . .)) := z k 

(Xk denotes the random state of the system at time k, k € M, uj £ fi), 

- Yfc(w) = Yfc((zi,ai,z 2 ,a2, • • •)) : = a k 

(Y k denotes the random action taken at time k, k 6 IN, w € Q), 

- Hk := (Xi, Yi, . . . ,-Xfc), 

that means flfc(u/) = H k ((zi,ai, z 2 ,a 2 , ■■■)) = (21,01, z 2 ,a 2 , ■ ■ ■ ,z k ) 
(H k describes the random history at time k, k E M, oj G f2) 

hold and P^ is defined by 

- P^Xi = 0) := 1, 

- P w (X k+1 = z\H k = (zi,at, . . .,z k ),Y k = a) := t(z\z k ,a) 
if P n (H k = (zi, ai, . . . , z k ), Y k = a) > and 

-P 7T (Y k = a\H k = (z 1 ,a 1 ,...,z k )): = Y\ Pk U i 1 ~ Pk) 

{neJ\f:a n =l} {m£Af:a m =0} 

if P n (H k = (zi,ai, . . . , Zk)) > 
with z,Z{ £ Z for all i = 1 . . . , k and a, aj € A for all z = 1, . . . , k — 1. 

Equivalently, P^ can also be described as the unique probability measure on (f2, A) for which 

- P 7r (Xi = 0) := 1 and 

- P n (H k = (z 1 ,a 1 ,z 2 , a 2 , ■ ■ ■ , z k )) 
:=¥ 7r (X 1 =z 1 ) k f[t(z i+1 \z i ,a i )-( II P? II (1"PD)> 

i=l {riGAA:a" = l} {meA/^a™^} 

where Zj € Z for all i = 1, . . . , k and £ A for all i = 1, . . . , k — 1. 
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1.2 Expected payoffs and equilibria 

In this section the expected payoff for a given quitting game will be defined and additionally 
the terms Nash- equilibria, e- equilibria and approximate equilibria. 

In [7] the expected payoff for a quitting game G = (jV, (rs)t$cscj\f) and the strategy profile 
7T € II is defined with a stopping time r : f2 — > IN U {+00} where 

r(w) := inf {fc G IN : Y k (oj) e A\ {(0, . . . , 0) T }} 

concerning the filtration (^lk)keM with 21^ := cr{Yj : 1 < i < 

Definition 1.7 (Expected payoff) Ze£ G = (jV, (fs)^cscAf) be a quitting game and tt G II 
i/ie chosen strategy profile. The expected payoff of the game is given by 

7(tt) := E,(f(y r )l{r<oo}) 

wii/i f /rom remark HOI 7(7r) = (7 1 (7r), . . . , 7 Ar (7r)) r and E^ as expected value with respect to 
the probability measure ~P n . 

With use of the definition of and r (0) = r0 = one obtains 

7(7r) = E^(f(y r )lr<oo) 

= E E Ett(t = k, Y k = a k ) ■ f(ajfc) 

fceIN a fc eA 

= E ( E P -(^-i = (0,Q ) 0,Q ) ...,0),y fc = a fe ) .f(o fc )) 

= E(niK 1 -^)- E f (°*)- n p* n a-*?)) 

fcel i=l nGjV a fe 6A {neAA:a£=l} {m6AA:a™=0} 

and with remark Tl.21 follows 

7w=E(niK i -rf)- e ^-n^ n a -*?))■ 

fc e M i=l n€Af SeV(M) n£S m£Af\S 

Definition 1.8 (e-equilibrium, Nash-equilibrium, approximate equilibria) Let G = 

(A/", (rs)$cscj\f) be a quitting game. A strategy profile tt = (pi)«eiN is called e-equilibrium 
(e > 0) if for every player n G M and every strategy ir n of player n 

7 n (vr)>7 n ((vr- n ,7f"))- £ (4) 

holds. 

The strategy profile it = (pi)igM is called Nash-equilibrium or (0— ) equilibrium if tt is an 
e-equilibrium for e = 0. 

A game has got approximate equilibria, if for all e > an e-equilibrium exists. 

Definition 1.9 (subgame e-equilibrium) Let G = (Af, (rs)^cscAf) be a quitting game. A 
strategy profile tt = is called subgame e-equilibrium (e > 0) if for all j G IN the subgame 

profile TTj is also an e-equilibrium in G. 
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2 One-step game 

The consideration of so called one-step games is an instrument for analyzing quitting games. 
These games are also known as one-stage games ([5], p. 15) or as one-shot game ([7], p. 269). 

Definition 2.1 (One-step game) Let G = (TV, (fsOocsc/v) be a given quitting game. For 
every v € Ji N the tuple 

T v := (G,v) = ((M, (r s )®cscAf),v) 

denotes the one-step game corresponding to the quitting game G, where the players receive 
the payoff v if S = and r$ otherwise (0 ^ S C N). 

A one-step game has only one stage. The transition law, the state and action space are the 
same as the transition law, the state and action space of the quitting game (cf. remark H.2p . 
For the payoff function f v : A — > H N 



a (->• r v (a) :- 



"{n^N\a n =l} 



if a = 
otherwise. 



Definition 2.2 (Strategy profile, strategy in the one-step game) Let Y v = (G,v) be 
a given one-step game. A vector p = (p 1 , . . . ,p N ) T € [0, 1]^ is called strategy profile for the 
one- step game T v , where p n stands for the probability that player n will play the action quit. 
p n denotes the strategy for player n, n 6 M, in the one-step game T v . 

Notation 2.3 Letp € [0, 1]^ be a strategy profile for a one-step game T v andp n a strategy for 
player n. Similar to notation ! 1 . 61 p~ n denotes the strategy profile for the players j £ J\f\ {n} 
and (p~ n ,p n ) an alternative strategy profile for player n in which the players j G M \ {n} 
carry on playing p~ n , that means 



/ .1 



p 



jl—\ 



\P N ) 



and (p 



- n ,p n ) 



P 



P 
P 
p 



n-1 



n+1 



\P N ) 



Let I\, = (G,v) and p G [0,1]^ be given. Without loss of generality the game starts in 
the state z = 0. The corresponding probability space (Q,A,P p ) and the stochastic process 
(Xi,Yi, X2) are defined by 

- n := Z x A x Z, 

- A:=V{Z)®V{A)®V{Z), 



Xi{w) = Xi((zi, a, z 2 )) ■= Zi, i = 1,2, 
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- Yi(u)) = Yi((zi, a, z 2 )) := a, 

- PpiXj = 0) := 1, 
P p ({u>})=P p ((z 1 ,a,z 2 )) 

:=P p (X 1 =z 1 )-t(z 2 \z 1 ,a) U P n U (1-P m ), 

{n£Af:a n =l} {m£j\f:a m =0} 

with uj G fl, z\, z 2 G Z, a € A. 

The expected payoff 7„ for the one-step game Tind.Gr the strategy profile p £ [0, 1] is given 

by 

7„(p) := E p (f v (Fi)) 
as 6 A 

= P p (yi = a )-7;+ P p (Y 1 = a s )-r s 

where j v (p) = (jl(p), . . . , 7^ {p)) T and E p is the expected value with respect to the probability 
measure P p . 7™(p) is the expected payoff for player n (n G A/") in the one-step game T v under 
the strategy profile p. 

Notation 2.4 The function g : [0, 1]^ x V{M) -> [0, 1], 

(p,s)^ e (p,5):=np n n (!"A 

nGS m€N\S 

with p = (p 1 , . . . ,p N ) T , denotes the probability that a quitting coalition S or - equivalent to 
that - an action as G A is chosen under the vector p. 

With this notation for the expected payoff j v under the strategy profile p G [0, 1]^ follows 
lv(p) = Q(p,Q) ■ v + ^2 g(p,S)-r s . 

Proposition 2.5 Let F v be a given one-step game and p G [0, 1]^ a strategy profile in T v . 
Then for the expected payoff j v (p) 

ivip) e l-$v,S v ] 

holds for all n G J\f, where 

6 V :=max{max|*/ n |, max { |r§| | 5 G V{M)} }. (5) 

Proof: For all p G [0, 1]^ and all n G TV 

7?(p) = Q(p,®)-v n + 6(p,S)-r n s 

SeV(N)\{®} 

< e(p,0)-KI+ e(p,S)>\r§\ 

SeV(M)\{®} 
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holds. With S v like in © 

7«(P) < <?(p,0W» + 2 Q(p,S)-S v 

SeV(Af)\{Q} 

seV(AT)\{®} 

follows on the one hand and on the other 

7» > -<?(p,0)>"[- e(p,s)-\r n s \ 

SeV(N)\{®} 
seV(Af)\{d>} 

With 

e(p,0)+ 2 ^,5) = !, 

SGP(AT)\{0} 

7« (p) G [-?>v, &v] holds for all p G [0, 1]^ and n G /V. 

m 

In order to show that the expected payoff j v (p) is linear in the strategy p n of player n for all 
n G M the following proposition is needed. 

Proposition 2.6 For all p G [0, 1]^, all S G V(N) and all i G TV 

e(p, ^) = v l ■ q{(p-\ i), S) + (l - p l ) • o), 5) 

Proof: 

Case 1: i G S 
Because 

^,s)=n/ n ( i -^ n )=^- n p n n ^-p*)' 

with (p" 4 ,!)* = 1 and p n = (p~ l ,l) n for all n G J\f \ {i}, where (p~ l ,l) n denotes the n-th 
component of the alternative strategy profile for player i, 

g( P ,s) = P i -(p-\iy- n (p-\ir n (i-(p-\ir) 

neS\{i} neM\S 

= p i -\\{p-\i) n n (i-(p~md 

n€S neAf\S 

= p l - Q {{p-\l),S) 

follows. 

Case 2: i G TV \ 5 
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Because 

g( P ,S) = (l-p i )-l[p n J] (l-p n ), 
neS neAf\(su{i}) 

with (p~\ Of = and p n = [p~\ 0) n for all n E TV \ {i} 

g(p,S) = (l-p*)-(l-(p-W)-n(P^0) n II (1-(P- J ,0) n ) 

neS n£Af\(SU{i}) 

= (i- P *)-Yi(p-\oT n (i-(p~*.or) 

neS neAf\S 

= (i- P l )-e{(p-\o),s) 

follows. 

Because of 1), 5 1 ) = for i E A/" \ S and 0), 5) = for i E 5, case 1 and case 2 

imply the proposition. 

■ 

Proposition 2.7 Let Y v be a given one-step game. Then for all p E [0, 1]^ and all n 6 H 

Ivip) = 7v((p- n ,0))+P n ■ {7v((p- n , 1)) - 7v((p- n ,0))) 

holds, that means the expected payoff j v (p) is linear in the strategy p n of player n for all 
p E [0, 1} N and all n E N '. 

Proof: 

Ivip) = e(p,0) -v + ^2 Q(p,S)-r s 
With proposition 12.61 and g((p~ n , 1),0) = one obtains for all n E N 

ivip) = (p n - g {( P - n ,i),<H) + (l-p n )-e{ip- n ,o),<b))-v 

+ £ (p n -Q{(p- n A),S) + (l-p n )-Q{(p- n ,0),S))-r s 

SeV(Af) 

= (l-p n )-Q(( P " n ,0)^)-v + (l-p n ) e{(P~ n ,0),S)-r s 

+ P n £ Q{(p- n A),S)-r 3 

S£P(N) 

Furthermore 

7«((p^0)) = <?((?"", O),0)-t,+ £ Q(( P - n ,0),S)-r s 
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and 



j v ((p- n ,i))= Yl e((p- n ,i),S)-r S . 



That implies 



7„(P) = (1 ~P n ) • lv((p- n ,0)) +P n ■ lv({p-\ 1)). 



Conclusion 2.8 Let p € [0, 1]^ be a strategy profile in the one-step game F v . The following 
equations hold: 



for all i,n £ N , i ^ n. 

Definition 2.9 (e- equilibrium, Nash- equilibrium, approximate equilibria of the 
one-step game) Let T v be a one-step game corresponding to a quitting game G. The strategy 
profile p € [0, 1]^ is called an e-equilibrium for e > if 



Lf p is an e-equilibrium with e = 0, p is also called (Nash-) equilibrium. 

A one-step game T v has got approximate equilibria, if for all e > an e-equilibrium in V 



Because of the linearity of the expected payoff j v (p) in the strategies p n (n £ M) it is sufficient 
to consider the expected payoff only for pure strategies in order to find out whether a given 
strategy profile in a one-step game is an equilibrium or not, since the extreme values of 7^(p) 
is for each single player attained in a border point. The following example illustrates this 
fact. 

Example 2: Consider example 1 again. The corresponding one-step game T v for ci vector 
v = (v l jV 2 ) T G R 2 is given by 



1. lv (( P - n , i)) = p l i v {{{p- n , i)) + (i - p l hv{{( P - n , i)"\o)) 

2. 7,((p- n ,0))=p 4 7,(((p- n ,0)-M)) + (l-^)7„(((p- n ,0)- i ,0)) 



Vn G M Vp n € [0, 1] : 7 » > 7, n ((p" n ,p n )) 



— e. 



exists. 



Player 2 



continue 



quit 



Player 1 



continue 
quit 



( v 1 , v 2 ) 
(1,-1) 



(1,1) 
(-2,-2 



Consider four different given v's: 
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1. V\ 



The strategy profile p = f ^ ^ is a 0.1-equilibrium with the expected payoff 

7„M = 0.9.(^) + 0.1.(_;) = (^ 

Because if player 1 chooses to play continue while player 2 keeps on playing continue 
he has got an expected payoff of 7^((0, 0) T ) = 2, which is 0.1 better than his expected 
payoff under p. If he plays quit his expected payoff would be 7^ 1 ((1, 0) T ) = 1. 

Otherwise if player 2 chooses to play quit while player 1 keeps on playing quit with a 
probability of 0.1, player 2 gains a payoff of 

7„ 2 1 ((0.1, 1) T ) = 0.9 • 1 + 0.1 • (-2) = 0.7. 

Player 2 would even change for the worse. 



2. v 2 



The strategy profile p = ( J J is a Nash-equilibrium with the expected payoff 7i, 2 (p) = 

j ^ . Because if player 1 chooses to play continue while player 2 keeps on playing 

continue he has got an expected payoff of tJ 2 ((0, 0) t ) = and if player 2 chooses to play 
quit while player 1 keeps on playing quit, player 2 gains a payoff of 7^ ((1, 1) T ) = —2. 
Player 2 would even change for the worse, too. 

3 ' V3 = ( , 

Analogously to case 2, the strategy profile p = ( ) is a Nash-equilibrium with the 



expected payoff 7„ 3 (p) 

4 V4 = ( , 

The strategy profile pi = f J ^ is a Nash-equilibrium with the expected payoff 
7^4 (Pi ) = f J J • Analogously P2 = f ^ J is also a Nash-equilibrium with the 
expected payoff 7„ 4 (p2) = f | ^ • 

Obviously the choice of v is important. This leads to the question which v's are expedient 
referring to finding an (e-)equilibrium in the corresponding quitting gam^ll • For example: It 



1 Simon therefore introduced in [5] the term feasible for a vector v 6 M. N : A vector v € M. N is feasible if it 
is in the convex hull of {rs|0 / S C A/"} U {0}. 
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does not make sense to choose v like in the first case, because in the corresponding quitting 
game the expected payoff's are limited by one for each player. 

Furthermore proposition 12.71 motivates the definition of the best reply, but before stating the 
definition it is necessary to introduce the mapping supp. supp : [0, 1] — > V({0, 1}) denotes 
the actions that are played with positive probability under p, that means 



supp{p) :- 



{0} for p = 
{0, 1} for p G (0, 1) 
k {1} for p = 1 



Definition 2.10 (best reply, perfect) Let F v be a given one-step game and p G [0,1]^ a 
strategy profile in T v . An action b G {0, 1} of player n is an e-best reply for p~ n if 

7:((p- n ,b)) > max Tj((p-»,6))- e 
be{o,i} 

n G Af. 

A strategy profile p 6 [0, 1]^ in T v is called e -perfect, if for every player n G N, every action 
b £ supp(p n ) is an e-best reply for p~ n . 

Remark 2.11 Let T v be the given one-step game and e > 0. The second part of the definition 
above is equivalent to the following: 



The strategy profile p for the one-step game T v is e-perfect, if 
Vn G N : < 



[ i:((P~ n , 1)) - 7£((p~ n , 0)) < e forp n = 

7 Z((p- n , 1)) - 7™((p" n , 0)) G [-£, e] for p n G (0, 1) . 
[^((p- n ,l))-^((p- n ,0)) > -e forp n = 1 



Now look at Example 1 again: 

Example 3: Consider the one-step game T v with v = ( ^ 



1. p 



1 



p is a Nash-equilibrum in T v , but is p also (O-)perfect? 
It holds that 

^ = 1 : 7, 1 ((P" 1 ,1))-7, 1 ((P~ 1 ,0)) = 1-0=1>0 

and 

p 2 = : 7j((p- 3 ,l))-^((p- 2 ,0)) = -2-(-l) = -l<0. 
So with remark \2. Ill p is perfect. 



2 Solan an Vieille used in [7] instead of the term "e-perfect" the term "perfect e-equilibrium" . This formu- 
lation is confusing with regard to theorem 12.121 The here used phrase is more accurate. 
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p is a 0.1-equilibrium, because: 

*m=m-(:*) +m .(_;H_£I 

If player one chooses to play continue, while player two keeps on playing p 2 , he gains a 
payoff of 0.1, which is less than before. 

If player two chooses to play continue with certainty, while player one keeps on playing 
quit, he anticipates a payoff of —1, which is 0.1 more than before. 

But is p also 0.1-perfect? 

The answer is no, because 

p 2 S(0.1) : ^((p- 2 ,l))-7 w 2 ((p- 2 ,0)) = -2-(-l) = -l^[-0.1, 0.1]. 

Which relation exists between (e-)equilibria strategy profiles and (e-)perfect strategy profiles 
(e > 0)? 

Theorem 2.12 Let T v be a given one-step game and e > 0. Then the following propositions 
hold: 

1. p € [0, 1]^ is e-perfect for T v ==> p is an e- equilibrium in Y v ; 

2. p € [0, 1]^ is an e-equilibrium in T v ==> p is e^ p -perfect for F V) 



where 



£, p := max£™ and £™ := 



max^,^) for p n G (0, 1) 



y I 1 f° r P n E I ' 1 ) 

Proof: 

1.: Let p € [0, 1]^ be e-perfect for T v . It is to show that p is also an e-equilibrium in T* v , that 
means 

7«(P) > max 7? -e 
pe[o,i] 

for all n € AA. 

Because of the linearity of 7™(p) with respect to p n (cf. proposition I2.7P it is sufficient to 
show that 

7»> max 7 »((p-»,p))-e (6) 
pe{o,i} 

for all nejV. 

Since p is e-perfect in r„, the inequality follows immediately for p n = and p n = 1. 
For p n € (0, 1) it holds either 
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(a) 7?((p-M)) >JZ(P) >^{(p- n ,0)) or 

(b) 7,"((p-",0)) > 7 » > 7 ,?((p- n ,l)). 

Case (a): With p e-perfect in and. remark 12. 1 H it holds 

7» > 7, n ((p- n ,0)) > ^((P" n ,l)) " e. 

Because 7™ = max 7"((p _n ,p)) 

pe[o,i] 

7 ?(p)> max 7 ?((p- n ,p))-e 

p€[0,l] 

follows. 

Case (b) : Analogously to case (a) with p e-perfect in T v and remark 12.111 
7» >7?((p"V)) >i:{(p- n ,0)) -e= max 7?((p- n ,p)) 

P6[0,l] 

follows. 

So for both cases © holds. 

2.: Let p be an e-equilibrium, that means for all n € M and for all p £ [0, 1] 

7,"(p)>%?((p- n ,p))-^ 
holds. That implies 

^(p)> 7 :{(p~ n ,l))-e 
for p n = and 

7, n (p)>7"((p~ n ,0))- £ 
for p n = 1. 

Consider now p n £ (0, 1). For all p £ [0, 1] 



7» = P n • i:{(p- n , i)) + (i - P n ) • i:{(p- n ,o)) > ^(( P - n ,p)) 

holds (c.f. proposition 12. 7|) . 
For p = 1, with JIQJ) 



e. 



(1 -P n ) -7„ n ((p- n ,0)) - (1 -p n ) ■ 1 :\{p- n ,l)) > -e 
follows and consequently 

7:(b- n ,l))-7:((p- n ,0))< T ^ r . 

For p = 0, with (JTUJ) 



p n -i:,{{p- n A))-p n -i:,{{p~ n ^)) > 
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follows and therefore 
That implies 

7 :((p-M))- 7 „ n ((p- n ,o)) e 



P 



6 



where f£ := max {j^, 
Denote M(p) := {n G jV | p n G (0, 1)} and 



max £™ if M(p) 7^ 

nSM(p) p 



1 



otherwise 



(11) 



With ©, © and (dU 














' 7 n((p-« 


1)) 


- 7 «((p-» 


0))<e 


for p n 


= 


Vn G A/" : < 


7 »((p-» 


1)) 


- 7 ?((p- n 


0)) G 


for p n 


G (0,1 




,7, n ((P" n 


1)) 


-7„ n ((p" n 


0)) > -6 


for p n 


= 1 



follows. With remark [2. Ill and £ p >l,p is e£ p -perfect in IV 



Remark 2.13 With jUP even 



Vn G A/" : < 



7™((p- n ,l))-7£((p- n ,0))<e 
7?((p-M))-7; i ((p- n ,0))G 
7 ™((p- n ,l))-7, n ((p- n ,0))> 



for p n = 
/or KG (0,1) 
for p n = 1 



holds. 



Conclusion 2.14 Lei r„ 6e a given one-step game. 

p G [0, 1]^ is (0-)perfect for F v p G [0, 1]^ is a Nash- equilibrium in T v 

Conclusion 2.15 Let T v be a given one-step game. 

p G {0, 1}^ is e-perfect for T v p G {0, 1}^ is an e-equilibrium in F v 



3 Equilibria in Quitting Games 

This section presents an imported result referring to equilibria in quitting games. It was 
proved by Solan and Vieille in [7], they showed that a cyclic e-equilibrium (e > 0) under some 
assumptions on the payoff function exists. 



15 



3.1 Preview 



This section studies the influence of a variation in one component of the strategy profile 
p G [0,1]^ for a given quitting game T^. Therefore define p G [0,1]^ cis follows 

P := Pm,x(p) := (P~ m , (1 - X)p m + A) , (12) 
where p G [0, 1]^, A G [0, 1] and m€Af. 

That means, p m is a convex combination of p m and the pure strategy 1, which accords to the 
action quit. For A = one obtains p = p and for A = 1 p = (p~ m , 1). 

Theorem 3.1 Let T v be a given one-step game, A G [0,1], p G [0,1]^ and m G M an 
arbitrary but fixed chosen player. Then the following hold: 

1. Q (p,$) = (i-\)q( p ,$) 

That means, the probability that all players play continue under p is for the X-fold 
smaller of the contmue-probability under p. 

2. lv (p) = (1 - A) • 7w (p) + A • 7,((p~ m , 1)) 

3- ||7«(p)-7t;(p)l| < M ' max 

where r max := max{|rS| I n G AT, S G V(S)} and 5 V = max{ max \v n \, r max } H 

4- If p G [0, 1]^ is r]-perfect in T v (rj > 0) and if p m G (0, 1] for the given player m G M 
holds, then p = p m ,x is fj -perfect in T v , with r) := max(2Ar max + (1 — A)r/,r/). 

Proof: 

To 1.: The definition of p (c.f. (fT2"j) ) implies 

g(p^)=H(l-p n ) = (l-(l-A)p m -A)- H (l-p n ) 

neM n£Af\{m} 

= (1-A). H(l-P n ) 
= (l-X)-g(p,$). 



To 2.: With proposition 12.71 and the definition of p 

7„(p) = P m -Jv{(p- m A))+(.l-p m )-Jv{(p- m ,0)) 

= ((1 - \)p m + A) • 7v {(p- m , 1)) + (1 - A)(l -p m ) ■ ~f v {(p- m ,0)) 

= (1 - \){p m ■ 7v (( P ~ m , 1)) + (1 -p m ) ■ lv ((p- m ,0))) + A • 7 ,((p- m , 1)) 

= (l-X). lv (p) + X. lv (( p -\l)) (13) 

holds. 

To 3.: Under use of (|13|) one obtains 

3 || • || denotes the maximum norm, that means ||y|| := max \y'\ for all y = (j/ 1 , . . . , y ) € H N . 
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Il7t,(p)-7t,(p)|| = ||(l-A)-7,b) + A-7,((p- m ,l))-7,(p)|| 
= ||A-7,((p- m ,l)) -A 7 ,(p)|| 
= X-\\ lv {(p- m ,l))- 7v (p)\\ 

< A-(|| 7 ,((p- m ,l))|| + ||7,(p)!|) 
Because player m plays quit with certainty in the alternative strategy profile (p~ m , 1) 

7"((p""\i))= £ <?((p- n M),s)-r§ e [-w,w] 

follows for all n G TV with r max = max{|rg| | n G TV, 5 G 7>(S)}. 

=^ IITuGp) - 7w(p)II < A • (r max + 6 V ) 
where 5 V = max{ max|f n |, r max }. 

To 4.: For A = and as well as for p m = 1, p = p follows and therefore p is //-perfect in T v 
in that case. 

For A G (0, 1] and p m G (0, 1) it is to show, that 

'lv((P~ n , 1)) - 7™((P" n ,0)) < fj for p n = 

Vn G TV : < 7"'((]5 -ri , 1)) — 7™((p~ n , 0)) G [—fj, fj] forp n e(0,l) (14) 
k 7?((P _n , 1)) " 7, n ((p~ n , 0)) > -fj for = 1 

holds with fj = max(2Ar max + (1 — X)r], rj). 

Case 1: Consider player m. With p 77-perfect and p m G (0, 1) 

7„((p- m ,l)) -7,((p~ m ,0)) =7,((p~ m ,l)) -7,(^,0)) G [-77,77] 

follows immediately and therefore the second inequality from (|14[) for p m G (0,1) respectively 
the last inequality of (|14p for p = 1. 

Case 2: Consider player n G TV\ {m}. 

With the definition of p for all i G TV and b G [0, 1] 



(1 - A) • (p~ n , bf + A fori = m 
{p~ n ,b) 1 foriGTV\{m} 



(p- n ,by 

follows. Under use of this and equation (|13p one obtains 

^((p- n ,b)) = (1 - A) • 7„ n ((p" n ,6)) + A • Y v l (((p- n ,b)- m , 1)). 
This implies 

7„™((p- n ,l))-7™((p- n ,0)) = (l-A). 7 , n ((p- n ,l))+A.7„ n (((p- n ,l)- m ,l)) 

- (1 - A) • 7„ n ((p" n , 0)) - A • 7, n (((p" n , 0)~ m , 1)) 
= (l-A).( 7 „ n ((p- n ,l))-7, n ((p- n ,0))) 

+ A( 7 ; i (((p" n , l)" m , 1)) - 7 ; i (((p- n ,0)- m , 1))) . (15) 
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(a) Consider player n G M \ {to} with p n = 0. 
p n = A ^-perfect => 7 , n ((p~ n ,l)) " T^Cp"", 0)) < r, 

With use of ^ and (fT6|) 

7 ?((p- n ,l))-7™((p- n ,0)) < (l-A)-77 

+ A- ( 7 :(((p- n ,l)- m ,l)) -7, n (((p- n ,0)" m ,l 

< (1 - A) - 77 

+ a • (| 7 , n (((p- n , i)- m , 1)) I + 0)" m , 1 

< (1 - A) • 77 + A (r max + r maa; ) 
= 2Xr max + (1 - A) ■ 77 

follows. 

(b) Consider player n £ J\f\ {to} with p n £ (0, 1). 

p n €(0,l) A ^-perfect =► T?((p"M)) - 7?((p _n ,0)) € [-77,77] 
With this analogously to case 2(a) it follows immediately that 

7„ n ((p- n ,l))-7„ n ((r n ,0)) < 2Xr max + (1 - A) • 77. 
Under usage of (fT7|) and equation (fT5j) one obtains 

7„ n ((r n ,l))-7™((p- n ,0)) > -(l-A)-77 

- a • (K l (((p- n , i)- m , 1)) I + k n (((?- n , 0)" m , 1 

> -2Xr max - (1 - A) • 77 

and therefore 

7 „ n ((p~ n , 1)) - 7, n ((r n ,0)) G [ - (2A W + (1 - A) • 77), 2A W + (1 - A) • 77 

(c) Consider player n G A/" \ {m} with p n = 1. 
p n = lA? //-perfect 7? ((?>""> *)) - 7" ((p" n , 0)) > -77 

With equation {19]), CE} and inequality CE]) 

7?((T n , 1)) - 7 ™((p" n ,0)) > -(2A W + (1 - A) • 77) 
follows. 
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Remark 3.2 (To theorem\37l\ 3.) 



1. Let T v be a given one-step game with v G [—2r max ,2r max ], p G [0,1] , where p m G 
(0,1) N for at least one player m G N , a strategy profile in T v and A G (0, 1). Solan and 
Vieille state in the following estimation: 

hv{i>)-lv(p)\\ <2Aw, (20) 
with p and r max like before. 

Counter-example: Consider the following one-step game T v with v = 





Pli 

continue 


iger 2 

quit 


„, , continue 
Flayer 1 

quit 


(1,2) 
(1,-1) 


(0,1) 
(-1 ,"0.5 ) 




r max = max{|rS| I n G Af, S G V{M)} = 1 and max \v n \ = 2 

n£Af 

=> 5 V = 2 

Obviously p = ( ^ ^ is one fane? f/ie on/yj equilibrium in T v with the expected payoff 
7„(p) = v. 

Xei A = 0.1 6e given. It holds that o(p,@) = 1 > 1 — A = 0.9. Furthermore let p\\ be 
defined like before, that means 

p 1 + A(l - p l ) \ _ ( + 0.1-1 \ _ / 0.1 



P^=P=\ p 2 J I I \ o 



It holds that 

7„(P) = 0.9.( 2)+0.l(_|) = ( 1 1 7 

From this 

I|7«(P)-7«(P)H = II ( i 7 ) " ( 2 ) II = 0- 3 = Hrmax+Sv) > 2Xr max = 2-0.1-1 = 0.2 
follows. So estimation 120\) does not hold. 

Furthermore the counter-example shows that the estimation in theorem \3.1\ 3. is even 
the best estimation. 

2. Interpretation: Let T v be a given one-step game, A G [0, 1] and p G [0, 1]^ with p m G 
(0, 1) for at least one player m G N ' . If the continue probability of one player m (m G J\T) 
is decreased by the X-fold, then the expected payoff of the players changes maximal at 
X(r max + 5 V ) for a component. 
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Remark 3.3 (To theorem 13.11 4.) Assuming that p m = in theorem l3.il I., P m = A € 

(0, 1) follows. In order to prove that p is fj -perfect it is to show that 

7 „ m ((p- m , l))-7r((P _m , 0))e[-fj,fj] 

But with p rj-perfect only 

lv{(p- m ,l)) -M(P~ m ^)) =7,((p" m ,l)) -lv{(p- m ,0)) <n<f, 
follows. 

For the other direction holds 

7 „((p- m ,l)) -7,((p" m ,0)) = 7,((p- m ,l))-7,((p- m ,0)) 

> " |7,((p- m ,l))|-|7,((p" m ,0))| 

however this holds for all p € [0, 1]^ in T v . 
But the proof that 

Vn € AT\{m} :l ^((p"™, 1)) - ^{{p~ n , 0)) G [~fj,fj] 

b:((p- n A))-i:((p- n ,o))>-v 

will remain unaffected from this case. 

Conclusion 3.4 With theorem \3.1\ A. it follows immediately that if p € [0,1]^ with p m € 
(0, 1), for at least one m € N , is (O-)perfect in T v (and therefore an equilibrium in T v ), p is 
2^r max -perfect in T v . 

The following example shows, that the estimation in theorem 13.11 4. is even the best approx- 
imation. 

Example 4: Consider the following one-step game T v with v = (yg, ¥f) T G R 2 given by 





Player 

continue 


2 

quit 


, continue 
Flayer 1 

quit 


( 9/10, 10/9 ) 
(1, "I) 


( 1/2, 1 ) 
(-1, 1) 



^max — 1 



Let p = f q J be the given strategy profile in T v . It holds 

7i((p~\l))-7i((p~\0)) = 1 - v x = 1 - ^ = 0.1 G [-0.1, 0.1] and 

7„ 2 ((P" 2 ,1)) -7, 2 ((P" 2 ,0)) = 0.1 • 1 + 0.9-1 -0.1 -(-1) -0.9 — 

= 0.1 < 0.1. 

Therefore p is ry-perfect in with rj — 0.1. 



for p n = 
forp n G (0,1) 
for p n = 1 
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1 - A) • p 1 + A \ _ / 0.8 • 0.1 + 0.2 \ _ / 0.28 



Let A = 0.2 be given. 



\ v 2 ) V o ; v o 

For p the following hold 

^((p- 1 ,!))-!^- 1 ^)) = 1 - ^ = 0.1 G [-0.1, 0.1] and 

ll{(p- 2 A)) -t5((p~ 2 »0)) = 0.28- 1 + 0.72-1 - 0.28- (-1) -0.72 

= 0.48 

= (1 - \)r) + 2\r max = 0.8 • 0.1 + 2 • 0.2 • 1 = 0.48. 
So p is only 0.48-perfect in and the estimation in theorem 13. II 4. holds. 

3.2 Equilibria under some assumptions on the payoff function 

This section shows which importance one-step games have, referring to the detection of equi- 
libria in quitting games. 

Firstly an important theorem from Solan and Vieille, stated in [7] is quoted. The proof of this 
theorem is divided into three parts, represented by the propositions 13 . 61 13 . 81 and [3791 Secondly 
the proposition 13.61 is proved at length by using the now known results about one-step games 
and their strategy profiles. 

Theorem 3.5 Let be e > 0. Every quitting game G that satisfies the following has a cyclic 
subgame e- equilibrium. 

1 . r| n | = 1 for every n G N ; 

2. r'g < 1 for every n £ M and every S such that n G S. 

Before quoting the above mentioned propositions another notation is needed. 

Let V be a subset of M, N and e G (0, 1) be given. ip £ denotes a correspondent^ from V into 

V, where 

ip e (v) := ip E y(v) := {jv{p) I lv{p) G V, p G [0, 1]^, p 2er max -perfect, g(p,$) < 1 - e}. 
Proposition 3.6 Let e G (0, 1) be given. Define 

V := {v G [-2r max ,2r max ] N \ 3n G N : v n < l}. 
Assume that 

1. r™ n | = 1 for every n G M 

2. for every v (zV an equilibrium p in T v exists, such that either 

(a) p= (0,0, ... ,0) T (that means all players choose continue ) or 



4 Let K and L be sets. A correspondence J : K L is a subset J of K x L and one defines for all k £ K: 
J(k) := {l\(k, I) G J}. It is not assumed a priori that J(k) for all or any particular k € K. 
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(b) P 7^ (0, 0, ... , 0) T and 7™(p) < 1 hold for some n G Af with p n > 0. 
Then tp £ (v) ^ for all v € V. 

Remark 3.7 1. Let G be a quitting game, which satisfies the assumptions of theorem 
13.51 and T v a corresponding one-step game to G with v £ V. Then a strategy profile 
p € [0, 1]^ exists, which satisfies the assumption 2 of proposition [X51 

Proof: That every one-step game has got an equilibrium was shown in J^. The 
proof uses Kakutani's fixed point theorem. Furthermore either p = (0, . . . , 0) T or 
p 7^ (0, . . . , 0) T holds. For the second case it is to show, that there a player m with 
p m > and 7™(p) < 1 exists. Because of p ^ (0, . . . ,0) T at least one player m £ Af 
exists with p m > 0. 

Consider the case that p m = 1. Then with the assumption 2 of theorem VJ. 51 



SeV(AT) 

Q(P, S U {m})rf u{m} 

< g(p,SU{m})-l 
®^SCN\{m} 
1 



follows. 

Consider the case p m £ (0, 1). Because p is an equilibrium in T v , p is also (O-)perfect in 
T v . This implies "f v 7l (p~ m , 1) — 7™(p~"\0) = 0. Analogously to the case above it follows 
that 7™(p _m , 1) < 1 and with use of the linearity of ^ v {p) in p m one obtains 



2. The assumptions of proposition \3.(A are basically there to allow the in remark \3.3\ men- 
tioned estimation below for p = (0, . . . , 0) respectively to ensure that p m £ (0, 1] in the 
case p (0, . . . , 0) T . 

Proposition 3.8 Let e £ (0, 1) be given. If a compact set V exists such that ip e (v) ^ for 
all v £ V, then a cyclic profile ir = (pi)igM in G exists, such that for every i £ W; 

1. 7Tj = (pj)i<jeM is terminating and 

2. pi is (2r max + 2)e-perfect in 7 7 (tt 1+1 )- 

Let G — (TV, (rs)<DcscAf) be a given quitting game and tt G II the chosen strategy profile. If P,(r < 
+oo) = 1 the game G is called terminating. 



7, m (p) 



77(p) = 7r(p- m ,i)<i- 



(21) 



22 



Proposition 3.9 Let tt = (pj)ieM be a strategy profile in G. Assume that the following 
properties hold for every i G IN; 

1. 7Tj = (pj)i<j£N is terminating and 

2. pi is e-perfect in 77(7^+1) • 

1 1 
Then either tt is a subgame £6 -equilibrium, or there is a stationary eg -equilibrium. 



3.2.1 Proof of Proposition [3761 

Proof: Let v G V and e G (0, 1) be arbitrary but fix. The aim is to construct ap£ [0,1]^ 
with j v (p) G i> £ {v)- 

It holds that ipe{v) ^ 0, if a strategy profile p G [0, 1]^ in T v exists, such that 

(i) 7„(p) eV={ve [-2r max ,2r max ] N \ 3n £ N : v n < l} 

(ii) p is 2er moa; -perfect in 

(iii) g(p, 0) < 1 - e. 

Now let p be an equilibrium in Y v that satisfies the assumptions of the proposition^. 

To (i): If p = (0, . . . , 0) T , then -y v (p) = v G V holds. In the other case (p ^ (0, . . . , 0) T ) 
the proposition postulated that a player m G M exists such that 7^(p) < 1. Furthermore 
with the definition of V , proposition 12.51 and 

^ = max { max \v n \, r max \ < max { max \v n \, r max \ = 2r max 

j v (p) G [-2r max ,2r max ] N holds. That implies 7^(p) G V. 

To (ii): Conclusion 12.141 implies that p is even 0-perfect in T v . 

To (iii): For p = (0, . . . , 0) T , g(p, 0) = 1 £ 1 - e holds and for p ^ (0, ... , 0) T , g(p, 0) < 1 
but not necessarily g(p, 0) < 1 — e. 

So j v (p) is not necessarily an element of ip e (v) . 

Based on the given strategy profile p, a new profile p G [0,1]^ like in section 3.1 for the 
one-step game r„ will be constructed such that g(p, 0) < 1 — e holds. Afterwards it will be 
shown that this profile p satisfies the conditions (i) and (ii), stated at the beginning of this 
proof, as well. 

First to the construction of p: Fix a player m with v m = 1 if p = (0, . . . , 0) T or with p m > 
and 7™(p) < 1 otherwis^ll and set p like in (fTZj) . that means 




for n = m 
for n ^ m 



6 Such a probability p £ [0, 1] exists, c.f. remark T3. 71 

7 Let p = (0, . . . , 0) T be the given equilibrium in F v . Since v € V, a player m 6 M with v m < 1 exists. 
Because p is an equilibrium in F v , v m = 1 follows. Assume that v m < 1, then player m could change for the 
better, if he chooses to play quit with certainty, hence — 1 (c.f. assumption 1. of proposition 13. 6p . This 
is a contradiction to p is an equilibrium. 
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Theorem 13. II 1. implies 

e(p,0) = (l-e)-g(p J 0)<l-e. 

To (i): It will be shown that 7„(p) £V = {v £ [-2r max ,2r max ] N | 3n G N : v n < l}. 
With proposition 12,51 and 8 V < 2r max , 7„(p) G [—2r max ,2r max ] N follows. Consider the chosen 
player m G N . Because p is an equilibrium in T v 

holds and with the special choice of player m 

1 > l™(p) > l™(p) (22) 
follows. So J v (p) G V. 

To (ii): It is to show that p is 2er max -perfect in r„. 
Case 1: p m G (0, 1] 

With theorem 13.11 4. and p (0— )perfect in T v it follows immediately, that p is 2er max -perfect 
in r„. 

Case 2: p m = 

(a) Consider player m. Because p is an equilibrium in T v , p is also (O-)perfect in T v . With 
this and p m = 

7 r((r m ,i))-7 t m ((p- m ,o)) = 7r((p- m ,i))-7r((p- m ,o)) 

= 1 - 1 = e [-0, +0] 



follows. 

(b) Consider player n G M. With theorem 13.11 4. and remark 



Vn G Af \ {m} : < 



' 7 ™((p- n , 1)) - 7?((P~ n , 0)) < 2er max for p» = 

7^((p" n ,l)) -7"((P"™,0)) G [-2e W ,2e W ] forp™ G (0,1) 
k 7?((P~ ft , 1)) - i:((p- n , 0)) > -2e W for p» = 1 



holds. 

Together with Case 2(a) follows that p with p m = is 2er max -perfect in the one-step game 

rv 

So p G Ve(^) 7^ for all DEV. 
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